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In this paper we apply the Volterra representation of nonlinear systems 
to the echo control problem and propose a generalized adaptive echo canceller 
which compensates for nonlinear echo paths. We prove that the proposed 
echo canceller converges and reduces the echo to zero and finally we suggest 
other applications for the system. 

I. INTRODUCTION 

The Volterra functional representation of a nonlinear system is a 
generalization of the well known convolution integral used for linear 
systems. The validity conditions for the Volterra model are suffici- 
ently weak to be satisfied in many practical applications. 

In this paper we apply the Volterra representation to the echo con- 
trol problem and propose a generalized adaptive echo canceller which 
compensates for nonlinear echo paths. We prove that the proposed 
echo canceller converges and reduces the echo to zero in the absence 
of noise. We also suggest other applications for the adaptive echo 
canceller presented. 

II. THE VOLTERRA FUNCTIONAL REPRESENTATION OF A NONLINEAR 2-PORT 

For linear systems it is well known that the impulse response com- 
pletely determines the input-output relationship. The output signal, 
y{t), is functionally related to the input, x(t), by the convolution 
integral, 



y(t) = f h(r)x(t - t) dr, 

J-eO 



(1) 



where h(t) is the system impulse response. It has been demonstrated 
by other investigators 1-3 that nonlinear systems, whose outputs do 



2797 



2798 THE BELL SYSTEM TECHNICAL JOURNAL, OCTOBER 1971 

not depend on the infinite past, obey a more general functional rela- 
tionship, 

y(t) = h (t) + f *i(ti)*(* - ti) dn 

J-a, 

+ / / h 2 (ri , T 2 )x(t — Tj)x(t — n) rfr, dr 2 

J —oo » —00 

+ t, T ■■■ T Un , • ■ • , r B ) ft X(t - r.) dr.- . (2) 

n = 3 J-eo ''-oo i = l 

J I 

This is an extension of the familiar power series representation of 
a memoryless nonlinear system and provides for the system to have 
memory. It is applicable to all nonlinear systems whose outputs de- 
pend on the remote past to a vanishingly small extent. For example, 
it is not applicable to hysterisis and/or switching systems. The terms 
of (2) were first studied by Volterra 4 and are called Volterra func- 
tional. The kernels, h n (rx, ••• , t„), are generally called Volterra 
kernels. 

For the systems that we are concerned with we will assume the 
following: 

(i) The zero input response, h (t), is identically zero. 
(ti) The system is causal so that hjji, t z , • • • , t„) = for any t, < 0. 
{in) The system is stable so that for all n, 

I • • ■ I [K(ti , • • • , r n )f dr! , dr 2 , ■ ■ • , dr n < <x> . 
Jo Jo 

J L 

Because of i we may rewrite (2) in the form 

y(t)= t,yn(t), (3) 



where 

y 



„(t) = P • • • P ^(r, , • • • , r„) fl [z(t - r.) dr,]. (4) 

Jo Jq t = i 



III. AN ADAPTIVE ECHO CANCELLER FOR NONLINEAR SYSTEMS 

We will now generalize the adaptive echo canceller proposed by 
Sondhi 5 to cancel the echo of a nonlinear echo path for which the 
Volterra representation is applicable. 
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Since the Volterra kernels are square integrable we may represent 
them by an 71 dimensional generalized Fourier series, 8-9 

Mr. .',,-•• ,**)= tt ■■■ E c fi .,......,. 

■r 4i (r.)r f .(T,) ••• r,„(r„), (5) 

where {Ti(t)}* is an orthonormal set complete in the L2 space. The 
coefficients of (5) are given by 

c u . t ,,.....,. - r r ... r*.( r , , r 2 , ••• , o 

Jii .'n •'n 

•r.xor,,^) ••■ r t .(T B )dr, •■■ tfr„ . (6) 

We will assume that the highest order nonlinearity is of order N. Then 
substituting (5) into (3) we obtain 

V(t) -EEE-Z C„. ,,.....,„ f r„(r,).r(/ - r,)dT, 

„=1 f,-| ,-,-1 ,„ = l ■'n 

• f° I\,(r 2 ).r(< - r 2 ) dr 2 ■ • • f r,„(r„).r(/ - r„) dr„ . (7) 

Before we proceed it will be convenient to adopt a shorthand nota- 
tion. We will define 



E(0- E Z •■■ £(•), os) 

/„ m=i i,=i i.-i 

C # . a C„., 3 . ....,„, (9) 

and 

Win ee /"" r,,(r>(( - r„) dr„ / (10) 

•'n 

Thus, (7) becomes 

2/(0 = E £ C Im w u Wi, • • • u>„, . (11) 



»=1 In 



Now consider the system shown in Fig. 1. It contains N subsystems 
designated by the circled numbers. The filters having the set of mutually 
orthonormal impulse responses IT,, (01 and the set of outputs (w,J 

♦Some typical sets {r„(0} are the impulse responses of tapped delay lines or 
Laguerre networks. 
f Note that w in is a function of t although it is not explicitly shown. 
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due to the input x(t) are common to all the subsystems. Subsystem 1 
produces the output of the filters taken one at a time. Subsystem 2 
produces all possible combinations of the product of the filter outputs 
taken two at a time (i.e., w^Wi,), and subsystem N produces all possible 
combinations of the filter outputs taken AT at a time (i.e., w ix w it Wiz • • • 
w in ). Every output tap of every subsystem has associated with it two 
multipliers and an integrator connected in the configuration shown in 
Fig. 1 for only three taps. Other quantities pertinent to the discussion 
below are also defined in Fig. 1. 

We will now show that the tap gains, G In (t), of the system converge 
to the generalized Fourier coefficients C In of (6) and, consequently, 
that y(t) converges to y(t) so that the residual echo, z{t), vanishes. 

We first define 

RiM - Cj, - <?/,(*). (12) 

Then, by inspection, the equation governing the gain of each of the 
taps of the pth subsystem is 

^# = \K\ w u w it • ■ ■ w iv E Z R Tm (fyD it w ia • • • w in : (13) 

Ul n=l /„ 



From (12) we see that 



dR ti {t) _ dG If (t) 
dt " dt 



(14) 



Also, 



dJ%M op ffl dJkM n*\ 

Applying (14) and (15) to (13) we obtain 

^^ - -2 | K | RjJfiWiW, • • ■ w ip S Z RMWiW, ■ ■ • w in . 

dt n=i /„ 

(16) 

Summing over all the taps within the pth subsystem, and over the 
iV subsystems, yields 



Z E Rid) - -2 1 k i (f; z RiMwtw. • ■ ■ »«-)"■ (17) 

„ = i I.. \n-l 7. / 



d_ 

dt p = i /„ \n=l /„ 

Note that the right-hand side of (17) is always negative or zero. 



* Where the set (ida • • • if) are the components of I P . 
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Also note that 

*(0- Z ZRUt) £0. (18) 

p=l /p 
Thus, we have a nonnegative function, whose derivative is always 
nonpositive, and conclude that ip(t) must be nonincreasing. It is 
strictly decreasing whenever 

E E RrMw<>w ia • • • w,. »< 0. 

n=l In 

Since, in general 

w ix Wi, • • • w in 7* 0, 
it is clear that 

lim 4f{t) = 0. (19) 

t—oo 

Since every term in if/{t) is positive, we further conclude that 

lim fl /p (0 = for p = 1, 2, ■ ■ ■ , N. (20) 

Applying (20) to (12) we see that 

limit G Ip (t) = C, ; p- 1,2, .. ,iV. (21) 

(-•00 

Thus we have shown that the tap gains converge to the generalized 
Fourier coefficients of /i„(ti , ••■ , t„), which is what we set out to 
prove. 

The reader can no doubt appreciate that solving (17) for anything 
but the final value would be difficult and would only be valid for a 
specific x(t). The solution for even a very simple input signal may 
not be tractable. We will not attempt such an analysis here. However, 
from (17) we see that the larger we make \K\ the quicker the echo 
vanishes. However, \K\ cannot be made arbitrarily large because 
doubling talking periods* will cause divergence problems. 

IV. EFFECTS OF CIRCUIT NOlSU AND OTHER CONSIDERATIONS 

The previous analysis assumes a noiseless output signal y(t). When 
circuit noise, n(t), generated in the echo path is present equation (17) 
would be written as 



* Doubling talking is said to occur when both speakers in a telephone con- 
versation are speaking simultaneously. 
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itH RUO = -2 | k I (t Z RtMw.w, ■ ■ ■ w,\ 

at , = , /„ \.>-i /, ' 

- 2 | K | »(f)(t Z RrXt)w,,w,, ■ ■ ■ v>t\ 

By choosing \K\ small so that the rate of change of the G Iv is small, 
it is reasonable to assume that n(t) is statistically independent of all 
other variables in the equation. Then, assuming n(t) has zero mean, 
upon taking the ensemble average of both sides of the above equation 
we obtain 

i((SP ; ' w » 

- -2 I K | (It, Z Bi.(flw«.»*. • • • ««-)/■ ( 22 ) 

The same argument used before then yields 

lim(i: E«l(0/-0' ( 23 ) 

(-00 \j=l /p / 

Of course, before this limit is reached our statistically independent 
assumption would no longer be valid, but at least we may conclude 
that convergence will take place until the noise power becomes com- 
parable to the echo power. 

There are several other difficulties associated with the echo can- 
celler. Recall that we represented the nth-order Volterra kernel by an 
"n" fold infinite summation [equation (5)]. Obviously, if such a sys- 
tem is to be implemented it cannot include an infinite number of 
elements and (5) can only be approximated by 

h„(r, ,■■■ , r„) « £ Z ' ' ' S ^„.. I .-.. n r.,(r 1 )r,,(r 2 ) ■ • • I\ b (t b ), 

(24) 

where the J's are finite and as small as possible for an adequate descrip- 
tion. 

Furthermore, even if the J's are small the system shown in Fig. 1 
requires a large number of components. However, one point may not 
be obvious. It can be shown that the Volterra kernels are symmetrical. 2 
As a result it may be verified that all the C, ,,...,„ are equal for any 
permutation of a specific set of numbers i u z a> • ■ •, C For example, 

W23 = ^231 = C312 = (/2ia> etc.. 
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Since the set of gains, G',,..., n , for any combination of a specific set of 
integers ii ■ ■ ■ i n are the result of the same physical operations, only 
one tap is required to account for all such terms. For example, consider 
the w 1 io 2 tap and the w a Wi tap. From Fig. 1, 



G 12 = J w,.w 2 [y(t) — y(t)] dt, 
G 2i = J w 2 Wj[y(t) — y(t)] dt. 



It is obvious that 

G 2l = G l2 . 
The contribution of G 12 and G 12 taps toward 4)(t) is given by 

y(t) 1 12 = G 12 WiW 2 + G 2l w 2 w x = (C?i2 + G 21 )w 12 = 2G 12 w 12 . 

Thus, the G l2 and G 2l taps may be replaced by a single tap. Any set 
of taps, (?,,...,„, for any permutation of a specific set of numbers, 
t"i • • • i„ , can be replaced by a single tap. This considerably reduces 
the total number of taps required. 

V. OTHER APPLICATIONS 

Although we have stressed the echo cancellation application, these 
ideas may also be useful in other areas. Two possible uses are described 
below. 

5. l Compensator for a Nonlinear System 

Assume that we wish to linearize the nonlinear system shown in 
Fig. 1, such that the resulting output, z(t), can be expressed by the 
linear convolution integral, 

z(t) = [ hiirMt - r,) d Tl . (25) 

This can be done by first allowing the adaptive system of Fig. 1 to 
converge long enough so that the members of the set [G Xj (t)\ can be 
considered to equal the corresponding members of the set { C/, } [equa- 
tion (21)]. After convergence, the members of the set JG/,} are forced 
to zero while the members of the sets { G /; } , ; ?* 1 are fixed at the values 
determined previously. As a result the compensated output will satisfy 
equation (25). 
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5.2 Nonlinear System Synthesizer 

Suppose one wishes to study the electrical characteristics of a non- 
linear system which cannot be brought into the laboratory. He could 
do this by making input /output tape recordings of the system, and use 
these as an input to a computer simulation of the adaptive system of 
Fig. 1. A good choice of an input signal would be white noise or any 
other easily generated broadband signal. By allowing the simulation 
to converge and then fixing the tap gains G, n at their final value, the 
nonlinear characteristic can be identified. Then it can be determined 
how the field system will behave for any arbitrary input by applying 
this input to the computer simulation with the tap gains fixed at the 
values determined previously. 

VI. SUMMARY AND CONCLUSIONS 

The Volterra representation is a concise method of characterizing 
nonlinear systems with memory when the output does not depend on 
the infinite past. It is a generalization of the convolution integral 
used in linear analysis, and many familiar concepts may be extended. 
Using the Volterra representation, we have proposed a generalized 
adaptive echo canceller capable of nonlinear compensation. A dis- 
advantage of the proposed echo canceller is its complexity. The pursuit 
of these ideas would be greatly enhanced if an efficient means of meas- 
uring the Volterra kernels of an unknown network could be found. 
The author and other researchers are presently working toward this 
end and several ideas have been proposed. To date, unfortunately, 
they all suffer from the complexity problem. 
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